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PORTABLE COMMUNICATION APPARATUS HAVING 
A CHARACTER RECOGNITION FUNCTION 



BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to a portable 
communication apparatus such as a portable telephone device 
5 or a personal information terminal, and in particular l.o a 
portable communication apparatus equipped with an 
image-capturing device. 

2. Description of the Related Art 

In general, a commercially available portable telephone 
10 device is provided with various kinds of information 

input means, for example, operation keys including a ten-key 
pad and an imago-cap t uring device such as a digital camera. 
Various types of camera-equipped portable telephones have been 
proposed (e.g. Japanese Patent Application Unexamined 
15 Publication No- 2002-232544) - 

A portable telephone device has a memory incorporated 
therein, which is designed to store telephone numbers, mail 
addresses and other character data. in general, these 
characters are manually entered one by one through an input 
20 device such as a ten-key pad. Accordingly, it is difficult 
to enter character data in a short time without operating 
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errors - 

On the other hand, optical character recognition devices 
or optical character readers are known well as disclosed 1 n 
Japanese Patent Application Unexamined Publication Nos . 
5 2002-I 33367 and 2002-74266. However, these conventional 
character recognition devices are not predicated on 
sma 1. 1 - si zed portable equipment and therefore cannot be applied 
directly to a portable telephone device . 

SUMMARY OK TH£ INVENTION 

10 An ob j ect of the present inven L ion is Lo provide a portable 

communication device allowing easy data input without errors . 

According to the present invention/ a portable 
communication apparatus includes: an image-capturing section 
for capturing an image depending on an operation of a shutter 

15 key; and a character recognition section for recognizing 
characters trom an captured image. The recognized 
characters may be displayed on a display and, if necessary, 
they are stored into a memory. It is preferable to determine 
the kind of the recognized characters, for example, e-mail 

20 address, URL or phone number. If il_ is an e-mail address, 
then a mailer program preferably starts. If it is a URL, then 
abrowser program automatically starts - Tf it. is a phone number, 
a call may be made at the phone number. 
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In this manner, necessary data can be entered through 
the image-captur ing section, allowing the user bo enter data 
in a short time without operating errors. 

Preferably, the portable communication apparatus 
b further includes: a display for displaying at least the 

captured image; and a character-size adjustment indicaLor 
providedon the display, wherein the character-size adjustment 
indicator comprises a reference frame having a size which 
provides a sufficiently high success rate in character 

10 recognition when at least one character included in the 
captured image fits into the reference frame. 

As an embodiment of the present invention, the 
character- si ze ad j ustment i ndicator may appear on the display 
when portable coinmunica L i on apparatus is set to a character 

15 recognition mode. Alternatively, the character-si ?.e 

adjustment indicator may be previously fixed on the display 
when portable communication apparatus is set to a character 
r ecogni t ion mode . For example , the character-si ze ad j ustment 
indicator is printed on the display. The reference frame may 

20 be shaped 1 1 Ice a rectangle oriented horizontally wi th respect 
to the displ ay - 

There is an optimum si^e of characters to be recognized 
by the character recognition section. The optimum size may 
be dependent on the si^e and resolution of the display, the 

25 resolution of an image processor, and the performance of 
character recognition section. Therefore, the 
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character-size adjustment indicator has the reference trame 
havinq a size providing a sufficiently high success rate in 
character recognition when at least one character included 
in the captured image tits into the reference frame. In order 
S that a strinq of displ ayed characters to be recognized fits 
into the reference frame/ the user moves closer to or away 
from the sub j ect to be captured . When the di spl ayed characters 
are appropriately accommodated within the reference frame, 
the user clicks the shutter key to capture the image including 

10 the characters. 

The portable communication apparatus further includes 
a timer for delaying an image-capturing operation of the 
image-ccipturing section by a predetermined time period after 
the operation of the shutter key has been completed. Since 

15 the portable telephone device is usually small-sized and 
lightweight, clicking the shut tier key causes its body to easily 
shake, so that the captured image becomes blurred, resulting 
in reduced character-recognition success rate. To prevent 
camera shake when clicking, an actual image capturing 

20 operation ol the camera section 17 is activated a lapse of 
the predetermined time period cifter the shutter key has been 
clicked - 

The portable couuuunicciLiun apparatus may further 
include: a program memory storing a plurality of proqrams 
25 including a mailer program and a browser program; and a 

processor ior executing at least one program thereon, wherein 
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when a string of the recogni zed characters represent s an e-mail 
address , the processor starts the mai 1 er program, when a siring 
of the recognized characters represents a URr. (uniform 
resource locator) , the processor starts the browser program, 
5 and when a string of the recognized characters represents a 
phone number, the processor starts makinq a call at the 
phone number . 

The portable communication apparatus may further 
include: a memory storing a plurality of types of recognition 

10 criterion each corresponding to different types of a string 
of characters to be recognized, wherein the character 
recognition section uses one of the types of recognition 
criterion to recognize characters from the captured image. 

According to another aspect of Lhe present invention, 

15 a data input method in a portable communication apparatus 
having an image-capturing function of capturing an image, 
includes: capturing an image depending on an operation of a 
shutter key; and recognizing characters from a captured image 
to enter the characters as input data. 

20 According to still another aspect of the present 

invention, a method for recognizing characters in a portable 
communication apparatus having an image-capturing device and 
a display, includes: a) setting a character-size adjustment 
indicator on the display, wherein the character-size 

2 5 adjustment indicator comprises a reference frame having a size 
which provides a sufficiently high success rate in character 



V 
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recognition; b) capturing an image depending on an operation 
of a shutter key when at lea.yt one character displayed, on the 
display fits into the referenrfi frame; o) recognizing the at 
leasL one character within Lhe reference frame from a captured 
5 image; and d) displaying recognized characters in a 
predetermined display area on the display. 

The method preferably further includes the step of e) 
repeating the steps b) — d) by sequentially selecting portions 
of a str.i ng of characters di spl a yed on the display, each porti on 

10 including at least one character which fits into the reference 
frame, wherein the recognized characters are displayed on the 
display by combining the portions in series, each of which 
includes at least one recognized character. 

The step c) may include: c.l) storing a plurality o£ 

1 S types of recogn i t i on cr i t.er i on ea oh corresponding t o different 
types of a string of characters to be recognized; c*2) 
determining a type of a string of characters to be recognized; 
and c.3) recognizing the at least one character within t-he 
reference frame based on a recognition cri teri on corresponding 

20 to the type of the string of characters to be recognized. 

BR I hi H* DESCRIPTION OF THE:, DRAWINGS 

FTG* 1.A is a perspective view of a portable telephone 
device in an opened state according to the present invention; 
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FIG, IB is a perspective view ol the portable telephone 
device in a closed state according to the present invention; 

FIG. 1C is a back plan view of the portable telephone 
device in an opened state according to the present invention; 



of the portable telephone device according to a first, 
embodiment, of the present invention; 

FTG- 3 is a flowchart showing a procedure of an 
irtiagc-capt uring operation of the portable telephone device 
10 according to the first embodiment; 

FIG. 4 is a diagram showing an example of a character-size 
adjustment indicator displayed on screen; 

FTGS- 5A-5C are diaqrams showing an character-size 
adjustment operation; 

15 FIGS. 5D is a diagram showing how to shoot a long string 

of characters; 



5 



FIG. 2 is a block diagram showing an internal circuit 



FTGS. 6A and 6B are flowcharts showing an operation of 
Lhc portable telephone device according to the first 
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embodiment; 

FIG. 7 1s a flowchart showing a procedure of an 
image-ciipturing operaLiori of Lhc porLable telephone device 
according to a second embodiment of the present invention; 

5 FIG. 9 is a flowchart showing a procedure of an 

image-capturing operation of the portable "telephone device 
according to a third embodiment of the present invention; and 

FIG . 9 i s a flowchart showing a character recognition mode 
setting operation of the. portable telephone device according 
10 to a fourth embodiment of the present invention. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

As shown in Ki gs . 1 A-1 C, a came r a — equ ipped portable 
telephone device 10 is composed mainly of three portions: a 
£irsl housing 11, a second housing 12, and a hinge section 
15 13 which connects the first housing 11 cind. the second housing 
12 so that they are freely opened and closed. 

The first housing 11 has a display 15, an antenna 16, 
a camera section 17, and a telephone-receiver ( speaker) 10 
provided on a main surface 111 thereof, which will be hidden 
20 inside when Lhc portable telephone device is closed. The 
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display 15 may be a liquid- cry s t al display,, on which necessary 
information such as calling phone numbers , e-mail messages 
or captured images are displayed- The camera section 17 is 
equipped with a small-sized and slim image-capturing device 
5 such as a CCD (charge-coupled device) or CMOS Image sensor, 
which is incorporated in the first housing 11 - The lens portion 
of" the camera section 17 is exposed and located on the main 
surface 111 at- the upper position thereof. 

The. second housing 12 has an operation keys and a 

10 telephone-transmitter (microphone) 19 provided, on a main 
surface 121 thereof, which will be hidden inside when the 
portable telephone device is closed- The operation keys 14 
are used to enter data or instructions such as communication 
operations. in this embodiment, a predetermined key of the 

15 operation keys 14 is used as the camera's shutter, 

A main circuit of the portable telephone device 10 is 
incorporated in the second housing 12- Another circuit 
i n c 1 u d i n q* the came r a s e ct ion 17 and the display 1. 5 is 
incorporated in the first housing '11 and is electrically 

2 0 connected to the main circuit through a wiring substrate - The 
circuit structure of the portable telephone device 10 will 
be described with reference to Fig. 2. 

1. First embodiment 
Ci rcuit struct, u re 
2b Referring to Fig. 2, the portable telephone device 10 
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has a communication system composed ot a radio transceiver 
201, a baseband processor 202, a coder/decoder (CODEC) 204, 
which are controlled by a central processing unit (CPU) 203. 
The CODEC 204 is connected to the speaker 18 and the microphone 
5 19. 

The CPU 203 executes necessary programs read from l\ 
program memory 2 0b to perform communica t ion and other data 
processing operations usinq a memory 20 6. The program memory 
20b stores an operating system and a plural ity of application 

10 programs including a character recognition program, a mailer 
program, and a browser program. The memory 20 6 stores 
phone numbers, mail addresses and Web site addresses, which 
are registered by default or by a user operating the operation 
keys 14 or the camera as described later. 

15 The camera section 17 captures an image depending on 

user's instruction. The captured image is stored in an 
image memory 207, is displayed on the display lb, and is 
processed by an image processor 20 3 under the control of the 
CPU 2 0 3* The character recognition of the captured image is 

20 performed by the character recognition program running on the 
CPU 203, which will be described later. Power supply to the 
circuits is controlled by a power supply controller 209 
supplied with power by a power source such as a battery, 
Chara c t e r i z e ai d j us tru e n t indicator 

25 Tn this embodiment, the portable telephone device 10 

can be set to a selected one of operation modes : telephone mode; 
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camera mode; character-recognition mode; e-mail 
transmission mode; and web browsing mode. 

Referring to Fig. 3, the CPU 203 controls the display 
15 so that a mode setting menu is initially displayed on the 
5 display '15 (step S100) „ When the character-recognition mode 
is uclccLed (sLcp S110), the CPU 203 creates ^\ character- size 
adjustment indicator 31 to display it on the display 15 as 
.shown in Fig. 4 (step SI 20). The sue of displayed characters 
on bhe screen can be changed by a user moving closer to or moving 

10 away from the subject to be captured. After having adjusLed 
the size of" characters so as to fit into the character-size 
adjustment indicator (step 5130) , the user clicks the shutter 
key to capture an image including the characters (step S140) - 
As shoun in Fig. 4, the character-size adjustment 

15 indicator 31 appears like a reel: angular frame horizontally 
oriented on the display 15 at the approximate center position 
thereof. The character-size adjustment indicator 31 may be 
located at the upper or lower center position oil L'he display 
15 . The character- size adjustment indicator 31 is a reference 

20 frame composed of four corner marks 31a-31d, upper center mark 
31e, lower center mark 31f , and a center mark 31g. The size 
of the character-size adjustTnent indicator 31 is determined 
so LhaL lhe character recognition process on Lhe CPU 203 can 
provide the highest success rate in recognition. Recognized 

25 characters are displayed in a recognized character display 
area lba. 
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As shown in t'ig. 4, the character-size adjusLment 
indicator 31 is preferably oriented in the longitudinal 
(X-axis) direction on the display IS because it is very 
difficult for a user to read characters arranged in the Y-axis 
5 direction on Lhe display 15. The shape of the character-size 
adjustment indicator 31 is preferably a rectangle but not 
limited to it. Any shape may be employed so long as captured 
characters are arranged therein, for example, a horizontally 
oriented rhombus, a square, or a horizontally oriented 
10 el 1. ipse * 

The character-si *e adjustment indicator 31 preferably 
appears on the display lb only when the character 
recognitionmode is selected (step S110) . Alternatively, Lhe 
character-size adjustment indicator 31 may be fixedly formed 

15 on the display lb. The chiiracter-sizc adjustment indicator 
31 may be formed by printing, engraving, molding,, or 
seal-adhering on the display 15. Such a fixed character-size 
adjustment indicator 31 eliminates the need of x program that 
insLruets the CPU 203 Lo display it on the display 15 when 

20 the character recognition mode is selected, resulting in 
lightened load on the CPU 203. 

As shown in Fig, 5A, the user adjusts the size of displayed 
characters on the screen by moving the portable telephone 
device 10 closer to or away from the subject to be captXJ red 

2 b so that the char act ers on Lhe screen fit into the char act er- size 
adjustment indicator 31. When the characters on the screen 
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lie off Lhe character-size adjustment indicator 31 as shown 
in Fig. 5B, the user, that is, Lhe camera 17 of the portable 
telephone device 10, moves away from the subject. When the 
characlora on the screen are too small with respect to the 
5 character-size adjustment indicator 31 as shown in Fig. 5C, 
the user moves closer to the subject - 

in this way/ Lhe size of characters on Lhe screen can 
be adjusted so that they fit into the character-size adjustment 
indicator 3*1 * When the characters on the screen fit into the 

10 charaeLcr-size adjustment indicator 31, they can be read at 
the highest success rate in recogni Lion . A recognized portion 
restricted into the character-size adjustment indicator 31 
allows a higher success rate in recognition and Lhe reduced 
time required reading characters - 

15 As shown in Fig. 5D, a long string of characters can 

be captured by sequentially shooting portions of the long 
string o± characters, which will be described later. 
Character re^c o qnition 

As described above, after having adjusted Lhe size of 

20 characters to be shot so as to fit into the character-size 
adjustment indicator 31 as described above, the user clicks 
the shutter key Lo shooL an image including the characters. 

Referring to Figs. 6A and 6B, when the camera section 
17 has captured Lhe image including the characters ( s tep S14 0 ) , 

25 the CPU 203 instructs the image processor 208 to process the 
image data (step SI 50) and, as ne.cexsary , stores the processed 
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imaqe data into the image memory 207 (step SI 60). 

Subsequently, the CPU 203 clips out an linage defined 
by the character-size adjustment indicator 31 (step 51.70) and 
calls the character recoqnition program to recognise the 
b characters within the clipped image (step S180) . The 

recognized characters are stored into the image memory 207 
or other memory (step Si 90) and are displayed in the recognized 
character display area Iba on the display lb (step S200) . 

When the recognized characters have been displayed in 

10 the recognized character display area 15a, the CPU 203 

instructs the di splay 1 5 to prompt the user to determine whether 
the character recognition shooting is repeated (step S210) - 
When the length of a string of characters is longer than Lhe 
longitudinal length of the character-size adjustment 

lb indicator 31 (YES in step S210) , it is necessary to repeat 
the steps S140-S200 to sequentially shooting portions of the 
string of characters several times as shown in Kig . 5D. 

For example, assuming that a string of characters is 
"hL Lp : / / www .biglobe.ne.jp" and the character size adjustment 

20 indicator 31 can accoiiuno date six characters, the first 

shooting captures the first six characters "http:/" and the 
recognized characters w http : /" are displayed on the recognized 
character display area 15a. The second shooting captures the 
second six characters "/www.b" and the recognized characters 

2b M /www.b" are displayed following "http;/" on the recognized 
character display area lba. Similarly, the Lhird shooting 
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captures the second six characters n iglobe" arid the recoqnized 
characters ^iglobe" are displayed following Vwww.b" on thft 
recognized character display area 1 5a . The fourth shooting 
captures the last six characters w . ue.jp" and the recognized 
5 characters ne.jp" are displayed following "iglobe" on the 
recognised character display area 15a. In Lhis manner, a 
string of characters that is longer than the character-size 
adjustment indicator .31 can be captured and recognized by 
sequentially shooting and recognizing portions of the string 

10 of characters several Limes. 

When the str inq of characters has been captured at a 
time or several (NO in step S210) , the CPU 203 instructs the 
display 15 to prompt the user to determine whether the 
recognized characters displayed on the recognized character 

lb display area 15a is edited (step S??0). If the recognized 
characters displayed on the recognized character display area 
15a includes errors or erroneously recognized characters (YES 
in step S220), then the user operates the keys 14 to correct 
or revise the errors or, as necessary, add characters (step 

20 S230) . 

When no ediLiun is needed (NO in step S220), the CPU 
203 determines whether the determined string of characters 
indicates a phone number (step 3240) . when it is determined 
that it indicates a phone number (YES in step S240) , the CPU 
25 203 instructs the display 15 to prompt the user to determine 
whether Lhe phone number is registered (step S250). When 



. "2003 10/16 THU 16:31 

« i 



FAX 03 3288 3222 Katsuragi Patent -> MCGINN&GIBB 

16 



©019/048 



registration is selected (YES in step SZbO) , the phone number 
is registered into the memory 206 (step £260} . When 
registration is not selected (NO in step S250) or when the 
phone number has been registered into the memory 206, the CPU 
5 203 instructs the display 15 to prompt the user to determine 
whether a call is made at Lhe phone number (step S270) . When 
the calling is selected (YES in step S27 0) , the CPU 203 controls 
the baseband process or 202 and the radio transceiver 2 01 to make 
a call at the phone number (step S280J . 

10 When Lhe deturmiriGd string ol characters does not 

indicate a phone number (NO in step S240) or when the calling 
is not selected (NO in step S270 ) , the CPU 203 determines whether 
the determined string of characters indicates a mail address 
(step S290) . When it is determined that it indicates a mail 

15 address (YES in step S290) , the CPU 203 instructs the display 
15 to prompt the user to determine whether the mail address 
is registered (step S300) . When regist rat ion i s selected (YES 
in step S300), the mail ^ddr^ss is registered into the memory 
206 (step S310)- when registration is not selected (NO in 

20 yicp S300) or when the mail address has been registered into 
the memory 206/ the CPU 203 instructs the display lb to prompt 
the user to determine whether a mail is sent to the mai 1 address 
(step S320) . When the mail sending is selected (YES in step 
1S320) , the CPU 203 starts the mailer program, so that the user 

25 creates a mail and then sends it to the mail address (step 
S330) . 



. « 2003 10/16 THU 16:32 FAX 03 3288 3222 Katsuragi Patent -» MCGINN&GIBB 



121020/048 



FTQ5-616 I 7 

When the determined string of characters does not 
indicaLe a mail address (NO in step S290) or when Lhe mail 
sending ia not selected (NO in step S320) , the CPU 203 determines 
whether the determined string of characters indicates a URL 
5 (uniform resource locator) (yLepS340) . When i t is determined 
that it indicates a URL (YES in step S3 4 0) , the CPU 2 0 3 instructs 
the display 15 to prompt the user to determine whether the 
URL is registered (step S350) . When registration is selected 
(YJLS in step S350) , the URL is registered into the memory 206 

10 (step S360). When registration is not selected (NO in step 
S350) or when the URT. has been registered into the memory 206, 
the CPU 203 instructs the display 15 to prompt the user to 
determine whether access to the URL is made (step S370) * When 
the URL access is selected (YES in step S370), the CPU 203 

15 starts the browser program so that the user automatically visit 
the Web site without the need of other operations (step S380) . 

When the determined string of characters does not 
indicaLe a URT. (NO in step S340) or when the URT. acr:ftfifi is not 
selected (NO in step 5370), it is determined that the determined 

20 string of characters is data other than the abo vc-mon t ioned 
addresses, for example, postal address , name, or locat i on name . 
Therefore the CPU 203 instructs the display 15 to prompt the 
user to determine whether the determined string of characters 
is registered (step S390) * When registration is selected (YES 

2b in step S390) , the data is registered i nto the memory 2 0 6 (step 
S400) . When registration is not selected (NO in step S390), 
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the CPU 203 deletes the determined string ot characLcrs and 
terminates the characLer recognition process (step S410). 

2. Second embodiment 

According to the above-described first embodiment, the 
5 entire captured image is subjected to the image processing 
and only the image portion in the character -size adjustment 
indicator 31 is clipped out for the character recognition. 

According to a second embodiment of the present invention, 
in cunLraaL, the image processor 208 processes only Lhe image 

10 portion in the character-size adjustment indicator 31 and 
thereafter the processed image portion is used for the 
character recognition- Accordingly, the time required for 
image processing and characLcr recognition can be reduced. 

Referring to Ki g. 7, when the camera section 17 has 

15 captured the image including the characters (step S500), the 
CPU 203 instructs the image processor 208 to process the image 
portion in the character-size adj us Linen t indicaLor 31 (step 
5510) and, as necessary, stores Lhc processed image data into 
the image memory 207 (step S520) - 

20 Subsequently, the CPU 203 calls the character 

recognition program to recognize characters within the 
processed image portion (step Sb30). The recognized 
characters are stored into the i mage memory 2 07 or other memory 
(step S540) and are displayed in the recognized character 

25 display area 15a on the display 15 (step S550) . Thereafter, 
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the steps S210-S4 10 are performed as described before. 

3> Third embodiment. 

According to a third embodiment of the present invent ion, 
a timer 211 which is included in the CPU 203 is used to delay 
5 an actual image capturing operation of the camera section 17 
by a predetermined time per i od when the user clicks Lhe shutter 
key- Since the portable telephone device 10 is usually 
small-sized and lightweight/ clicking the 3hutter key causes 
its body to easily shake, :so that the captured image becomes 

10 blurred, resulting in reduced character-recognition success 
rate- To prevent camera shake when clicking, an actual image 
capturing operation of the camera section 17 is activated a 
lapse of the predetermined time period after the shutter key 
has been clicked- The predetermined time period may be 

15 delcrmincd bo be a time period during which the camera movement 
due to clicking the shutter key becomes sett] ed back- In this 
embodiment, the timer 211 is set for N seconds, lor example, 
about 0.5 seconds - Such a delay time period may be previously 
set by delaulL or may be determined to be a desired period 

20 by the user operating the keys 14 throuqh the display lb. 

Referring to Fig. 8, the steps SI 00-S130 are similar 
to those described in Fig. 3. After having adjusted the size 
of characters so as to fit into the character-size adjustment 
indicator (step S1 30) , the user depresses the shutter key to 

25 capture an image including the characters (step S60Q) and 
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Lhcn moves his/her finger off the shutter key (sLep S610) . 

When the CPU 203 deLecLs LhaL the finger is moved off 
the shutter key and thereby the abutter key goes back to 
Lhc normal position, the CPU 203 starts the timer 211 (step 
5 S620) . When N seconds have elapsed/ a timeout occurs (step 
S630) and thereby the CPU 203 activates the camera secLion 
17 to capture an image (step SG40), In this mariner, the 
influence of camera shake on the quality of imaqe can be 
effectively prevented, resulting in a sharp character image 
10 and thereby a higher success rate in recognition. 



4 . Fourth embodiment 

According to a fourth embodiment of the present, invention, 
the criterion of character recognition is changed depending 
on what kind of address is indicated by a sting of characters. 

15 The character recognition program to run on the CPU 203 has 
Lhc option ol selecting one of recognition modes dedicated 
for phone number, mail address and URL, and an automatic 
setting mode. When the recognition mode dedicated for 
phone numbers has been selected, the CPU 203 uses the criterion 

20 dedicated for phone numbers to recognise only phone numbers 
from the captured image. Therefore the success rate in 
recogn i tion and the recognition speed both become higher . It 
is the same with the other recogn i. tion modes. 

As shown in Fig. 9, in the character recognition step 

25 S180 of Fig, 6A and of Fig. 7 , the CPU 203 instructs the 
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display 1.5 to prompt the user to select one of the 
recognition modes (step S700) . 
p 2i£L lt2 number re co gnition 

When the recognition mode dedicated for phone numbers 
5 has been selected (stepS710), the CPU 2 0 3 reads t he phone number 
criterion and uses it Lo recognize a captured string of 
characters as a phone number (step $770) . In the case of the 
phone number cc.i.Le.rion r when a string of numerals arid a 
separator such as hyphen or parenthesis are found in the 

10 captured image, the CPU 203 retrieves only numerals 0-9 from 
the captured imaqe and omits the other characters. In most 
cases, a phone number includes hyphens or parentheses, which 
are used to discriminate between an area code and a prefix 
local number and between the prefix local number and a 

15 local number . 

In the case where the string of characters are 
sequentially captured every a predetermined length, if the 
firs I; character of second or 1 at.er captured string is the right 
parcnLhesis then it is not omitted only when the first 

20 captured string includes the left parenthesis w ( " . Assuming 
that the first captured string is "090(1234" and the second 
captured string is ^ ) 5678", the first character of the second 
captured string * ) " is not a numeral but an effective character 
because the first captured string includes " { " . As a result, 

25 the CPU 203 combines "090(1234" with ")567R" to recognize a 
string of characters "090(1234)5678" as a phone number. 
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Mail address recogni L ion 

When the recogni Lion mode dedicated for mail address 
has been selected (step S740 ) , the CPU 203 reads themail address 
criterion and uses it to recognize a captured. sLring of 
5 characters as a mail address (step S750) . In the case of 
the mail address criterion, when a string of characters "il" 
followed by a colon " : " or an a L sign "@" is found in the captured 
image, the CPU 203 retrieves only the following characters 
from the captured image and omits the other characters: 

10 1) numerals 0-9; 2) lower-case alphabetic characLcrs a-z; 3) 
upper-case alphabetic characters A-Z, 4) hyphen 5) at 

sign 6) under bar 7) colon and 8) dot 

In mosL cases, an e-mail address Is wiiLLen in Lhc 
following form: " e-mail : ube@de± . ghi j . no - j p" , Since the 

IS first string of characters "e-mail:" is not a part of e-mail 
address, the CPU 203 retrieves the string of characters "11" 
followed by a colon and omit "e-mail:'' from 

"e-mail : abc@def . ghi j . ne . jp" . When is found, the CPU 203 

recognizes the string of characters wiLhout "e-mail:" as an 

2 0 e-mail address. 
URL recognition 

When Lhc recognition mode dedicated for URL has been 
selected (step S7fc0) , the CPU 203 reads the URL criterion and 
uses it to recognise a cap Lured string of characters as a URL 

25 (step S770) . In the case of the URL criterion, the CPU 203 
recognizes a captured string of characters as a URL when a 
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string of the first seven or less characters of the captured 
characters match one of the following strings of characters: 
a) "https://"; b ) "http : / / " ; c) M s://": d) NX ://"; and e)"www.". 

These strings of characters are needed for URL riolation 
5 therefore, when these are found, the CPU 203 can determine 
that the captured strinq of characters is a URL. In this case, 
the CPU 203 retrieves only the following characters from Lhe 
captured image and omits the other characters: 1) numerals 
0-0; 2) lower-case alphabetic characters a-z; 3) upper-case 
10 alphabetic characters A-Z r 4) hyphen f>) 6) 7) 

8) >v ~"; 9) "?"; 10) n /"; 11) colon 12) dot and 

13) under bar " " . 

When the CPU 203 determines that the captured string 
of characters is a URL, all characters before the 
15 above-described st rings of a) toe) arcdeleted. In t hi s manner , 
the CPU 203 recognizes the captured string of characters as 
a URL . 

Aut omatic recognition 

When the automatic recognition mode has been selected 

20 (step £780), the CPU 203 recognizes a captured string of 
characters as phone number, mail address, URL, or other data 
without using any criterion (step S730) - Since no criterion 
is vised, a success rate in recognition decreases, compared 
with the case of using criterion, but the automatic 

25 recognition mode is still effective in the case where it is not 
determined which one of phone number, mail address, and URL 
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the captured string of characters is. 

The functions a3 described above may be implemented by- 
software programs running on the CPU 203. Such solLware 
programs may be stored i.n t:he program memory 20b incorporated 
5 in Lhc portable telephone device 10 or a removable- 
recording medium. The program memory 205 may be a memory chip 
such as RAM (random access memory) or ROM (read only memory) , 
EPROM (erasable programmable read only memory, EEPROM 
(electrically erasable programmable read only memory) , 
10 Smart memory™, flash memory, or rewritable memory card such 
as Compact flash™. An external recording medium may be used 
as the program memory 205 or. the removable recording medium, 
for example, CD-ROM, PD, MO, DUD-ROM, DVD-RAM, FD, or HDD. 



